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ABSTRACT 

The study examined the 2-year stability and validity 
of playroom observations of behaviors associat.ed with hyperactivity 
in 48 boys who were evaluated originall^ as outpatients in a child 
psychiatry clinic, an;d seen a^ain approximately 2'years later at 
follow-up. At both evaluations, the boys participated in two 
15-minute playroom procedures: a relatively unstructured free play- 
period; and a'relatively structured, restricted academic period. The 
observation measures of gross and fine motor activity,' sustained 
attention, and self-vocalization in both periods showed sign if icant 
stability over the 2-year period, even after tlie effects of age, and 
IQ were partialled out. Further, these behaviors generally showed 
significant improvement between the two observations. Thus, 
consistent with previous research and' clinical observations , 
,_iaviors ^typically associated with hyperactivity were found to show 
significant impro^/ement as the boys got older, although their . 
relative rank order remained stable, The results also indicated that 
a measure of hyperactivity generated at referral was significantly 
related to many of the observation |measure's. collected at follow-up. 
Taken together, these results suggest that the present playroom 
observation procedure is measuring stable and valid aspects of 
hyperactive behavior among a sample of clinic-referred boys. 
(Author/CL) ' . 
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Abstract ^ 

The present study examined the two year stability and 
validity of playroom observations of behaviors associated with 
hyperactivity. The subjects for the study -consisted of ii8 boys 
who were evaiuated. original ly as outpatients in a child psychiatry • 
clinic, and seen again approximately two ye'ars later at follow-up. 
,At both evaluations th'fe boys participated in 'two 15-minute playroom 
'procedures: a relatively unstructured Free Play period; and 
'a'-'reldtively structured. Restricted Academic period. The ob- ■ , 
sert'otion measures of gross'and fine" motor activity, sustained . 
att;ention. and self-vocalization in bot,h periods showed .significant 
stability over the two year period, even after^'the effects of age 
and I'Q were partial led'out. Further, these behavior's generally • 
showed significant improvement between the tw6 cbservations. 
Thus, consistent with previous research and clinical observations, 
behaviors typically, associated with hyperactivity were found to 
show-signlf icant 'improvem.ent as the boys got older, although their 
'relative rank order remained stable.' The results also indkated 
that a measure of hyperactivity^generated at Referral was sig- 
.nificantly related to many of the observation measures col lected - 
at Follow-up.' Taken together, these results .suggest that the. 
present, playr3)om observation procedure is, measuring stable and 
valid aspects of hyperactive behavior among = a sample of clinic- 
refe-fred boys. . • . ' . v' . . 



. Introduction • , - 

The current research group recently offered data (Mi-lich. 
Loney. & Landau. 198^) indicating tfiaf a playroom observation 
procedure can significantly identify behci^viors typically 
assoc-iated with .hyperactivity / Specif i call y. an independently- 
derived Hyperactivity factor was found to significantly predict 
observed measures of gross, and fine motor activity and sustained 
attentiOQv. among others. ' - ' 

The current study was designed to examine the two year stability 
and validity of these same playroom observation procedure^. . . , 
Such .follow-up assessments st|ould shed 'further light on the^ 
reliabhity and validity of these observations, ^ecifically. 
■ the- resuVts of this'study shoeim indicate whether the observation 
procedure is measuring' stable ^aspects of the children's be- 
haviorak repertoire, rather than merely situational demands 
associated with the initiarclinic evaluation. 

The results of the -current study also will offer data concerning 
the developmental course of hyperactivity. It is now widely 
accepted that the major symptoms of hyperactivity decrease 
with age. although the behavior of the older hyperaC'tive child 
is still distinguishable from that of his peers (Milich &' Loney/' 
•1979). However/an examination of the research li'ierature 
suggests that few. if any. observation studies exist documenting 
these chahges.. Instead, these conclusions rest primarily upon \ 
studies employing rating scales, laboratory measures, or 
, psychologic<]l 'tests. The results of the current study should , 
help rectify this problem. ; 



,\ . • ' Methods 

Subjects : • . ' 

Subjects for. the present study consisted of 48 boys who were consecu- 
ti"ve referrals to an outpatient child psychiatry clinic for dijagnostic • 

■ evaluation and seen again, at Follow-up approximately two years later 
(see Table 1). The initial Referral sample thus>included boys with a 
variety of behcyior problems and psychiatric clisorders. ^ Of the .IQO 
boys originally seen at Referral. 77>ere successfully i'oHowed-upVX. 
Thirteen of the 77 boys coiild only be seen at home so thgt no observa- 

f tion data could be collected. Another' 15 , boys were 13 years of age or 
older at. Follow-up and were' felt to be too old for the toys employed - ' 
in" the Free Play observation ^period. Thus, complete data were available 
for ^8 of the boys. . * ^ ' ^ ■ . ^ ' 

Proce dures; . ; ' ' ' . 

During the afternoons of both the Referral and Follow-up evaluations 
the boys participated- in two consecutive 15-minute .playroom observation 
procedures (see Table 2). 

Rating, scale factors : PTother and teacher versions^ of the Conners 
• rating scales were available for each boy in the study at both Referral < 
cind Fallow-up. Empirically-derived Hyperactivity and Aggression factors 
were' compu-ted for each boy at both Referral and Follow-up for both the 
mother CGuy. 1976) and teacher (LoneV & miich. 1982) versions. Measure 
of internal consistency (Gronbach's alpha) 'indicated acceptable co- 
hesiveness for eacrj factor (x=.85. range f rom .82'to -.89) . 
■ ' Chart rating factors : Empirically-derived Hyperactivity and 
Aggressiofi' factbrs'^were generated from ratings of the boys' psychiatric 
cliarts at, Referral. Previousj^eseprch CMilich et dl.. 1982) hod • 
. demonstrated that the Hyperactivity factor reflects both convergent and 



discriminant validity ..when rating scale and observation data were used 
as criteria. The Hyperactivity, factor consisted of the symptoms 'of 
• fidgetiness , impulsivit'y . attention , problems, and hvberattivitv , 
The Aggression factor consisted of negative affect and aggressive 
interpersonal behavi&r . • ■ 



Results , 

Tables. 3' and 4 present the results of the stdbility'correlations 
and the 'Correlated trtests between Referral; and 'FoI low-up for the 
Free Play' and Re^Ericted Academic, periods. As is evident,' al 1 
but one- of the Free .Plav' variables and 3 of the Restricted Academic „ 
variables show significant stability. Further, except for Worksheet 
items completed , 'these correlations remain significant after, the 
effects of age and IQ are partial led out. • ' 



Tables 3 and 4 also indicate that several of these measures exhibit 
significant improvement over time. Generally, measures of . 
'vocalizatio;npnd dross motor activity^ in the Free Pla?' period ancj; . 
sustained attention and vocalization in the Restricted Academic' 
period are significantly Improved at .Follow-up. The results' of 
the stabll-ity correlations and t-tests thus support the widely - 
.held belief that che mpjor symptoms of hyperactivity improve., 
with' time, out that a'child's rank order remains relatively constant. 

Tables presents results of analyses looking at the mother and- 
teacher ratings, perhaps the most widely employed di'agnostic aad 
outcome measures in the -hyperactivity literature. All four factors 
show sigriifi(9an5: stability and. except for Teacher Aggression, 
significant Wrovement' over time. , It is interesting to note that 
•the magnitude of the stability coefficients for many of the , 
observation variables afe comparable to those of the rating scale 
factors. 



' Tables. 6 and 7 present the correlations between the two symptom . 
factors from Referral and the observation variables froQj Follow-up. 
Consistent with the' earlier study looking dt the observation , 
variabiles from Referral (Flitich et al.. 1982). the /Hyperactivity^ 

.factor is significantly correlated with most of the Restricted *' 
Academic Variables and many of the Free Play ones. Irr contrast, 
the Aggression factpr shows few significant correlations. Further, 
the Hyperactivity factor makes a unique contribution to pj^editti|ig 
many of the observation variables. bey,ond the variance shared 
wJth the Aggression factor. 'These results s.upport "the continued . 
validity of the observation'^procedures. even over a p^iod of two 
years. , - • ' ' \ 



Discussion* 



The current study found that the'behdvior§ observed^in th^ 
playroom procedure show significant stability, even after the 
effects ot age qnd^ IQ are parfialled out. Further, the magnitudes 
of the coefficients are comparable 'to those obtained- for both ' . 
mother and 'teacher' rating -scales, the most .widely employed '( 
assessment procedures in the hyperactivity literature. These- 
results strongly suggest thdt the relatively briref playroSm 
procedure is/measuring stable aspects of the boys' behavioral ^ 
repertoire. 



The stjability of these findings cannot be attributed to the 
proposed covariation .between hyperactive and aggressive behavior,' 
(Lahey/6reen.,& Forehand.^ 1980"). Jhere is^ a large body of 
>liter9ture , documenting the stability and robustness^ of V^ures ■ 
of ag^ssive behavior, even^for periods lasting up to 15 years ' 
(cf.. Olweus. 1979^. However, in the current study the Aggression 
factor showed few significant relationships with the observation 
Variables., and it did not make a -unique contribution to any-of _ 
these variables, beyond the variance 'shared with the Hyperactivity 
factor. . . ■ • . . • ■ 

' The^esults'pf the current study appear to' offer some of the first 
observational data documenting the developmental course of hyper- 
activity. Specifically, there was a significant dec ireds.e over - 
. time -in gross mo^or activity an'd vocalization during the 
Free Play period' and an increase in the time speni^on-task 



during the Restricted Academic period. However, the fact 
that these soffie behaviors showed signi'f icant stabfli-ty suggests 
jhat a' child's relative standing, in the group hds' remained constant 
those boy's who are most symptomatic regarding these behaviors at 
'keferral tend to be -the ones having the most difficulty 
at Follow-u'p. This interpretation is reinforced by the finding 
that^the Hyperactivity factor generated' at' Referral is significantly 
correlated with iriany of .the Follow-up observation variables. - . 



^In summary/ the results of the current study indicate that a 
reratively brief sample of behavior observed in a clinic playroom 
can be used to -give stable and valid inforniation concerning the 
primary symptoms associated 'with 'hyperactivity. These include^' 
measures of/gross and fline. motor behavior, "as wel l-'as* of ^sustained 
. attention, 'further, the stability coefficients obtained are 
comparable to, those obtained for motherland teacher ratings of ' 
hyperactivity, ratings that. are based^ upon numerous observations 
Df' large samples of behavior spread oyer time. Finally, the, 
' current. results appear to offer the first direct observational ^ 
^4dence' for' the ^widely held belief that although the major 
symptoms of hyperactivity •may decreoise with advancing age. a 
■ child's relative deviance re.mains stable. 
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V ' , • . TABLE! 

; " ; DESCRIPTION OF SAMPLE (N=48) 

Selection C riteria at Referral :' . , • 

All male outpatient referrals to child psychiatry unit who: 

A) ■ were between 6-0 and 12-11 years old; 

B) were lin grades one through six; 

C) had a .WISC-R Full Scale. IQ > 70; 

D) had no peripheral sensory loss, psychosis, epilepsy, cerebral 
|. 'palsy, or unequivoctil brain damage; . • •■ 

E) we're not on CNS stintalant medication on the day of the . / 
\ evaluation; ^ ■ • • - i 

F) gave ^infqrmed consent to participate, in the study. 

' ■ ^- ■ " / ■ '■ ■ ' r ■ 
Selection Criteria at Follow-up : . • , ' " 

Less than 13..0 years. of age on. date of fql low-up evaluation. .. 

X at ' X at « 

c^nmple Description • Referral - (S.D.\ Follow-up . .(SJ^ 

WI3C-R Full Scale IQ - 100.1 > (11.^1) N.A., 

Hollihgshead & Redlich SES 3.5; (i.l) . 3.3 ' (1.2) 

''Age in Years ' 8.8 , .(14.0). • 10.9 (13^.3) 

WRAT .Reading Standard Score 97.8\ (13.6)\ > . ^/-^ (11.0) n 

• WRAT Spelling Standard Score. *93.1 Y12..9), - 90.7" (13.8); 

WRAT Arithmetic Standard Score .92.5 (11.2) • 85.2 (10.7), 

Time, in Months Since Initial . 25.5 m.2) 
■'Evaluation' - ,^ ' 
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'V • : • TABLE 2 ' . ><y^^ 
- *, DESCRIPTION OF PLAYROOM OBSERVATION PROCEDURES 

■ 3 X 5fli .Room .- One-way Mirror - ^ Tables ' ^ 
Two 15-Mihute PerfQcis: •• » ' • ^ ^ 

-A) Free play - same five toys on all four tables.. Child is free to 

' . ' play wi.th any of the toys he so desires; 
Bp pestriated acpdemic,- -worksheets with Coding-like items on three 
' ; ■ tables/ appealing toys, different from those used 

" \ ' ' during Free Play, on fourth.- Child is told to remain 
, . , L -seated.- work on the worksheets, and not play with the 
^ toys. . 

< * 

Behaviors Observed ; ' 

1) Grid^ crossings - the number of times the child crosse^l one of the 
16 grids taped on the floor; 

■ 2) Qut-of- sect - the percent of time spent out of a chair.- 

3) Fidgeting - the percent of , time spe% in repetitive, noni^urposeful 
, motor behavior; 
• i|) VocalizQt-ion - the percent of time the child spent making any 
audible vocal noise; ' . ' \ i 

5) Qn- task - the percent of time the chilcj spefit attending to a toy 

(during Free Play period) or a worksheet (dut^lng Restricted 
, Academic period); • ^ v \ ^ 

6) Attention shifts - the numberof times the child shifted between 

on- and off-task^or between different forms of on-task; 
• 7) Forbidden toys - the percent of time the child spent touching the 
forbidden toys during the Restricted Academic period. 

Behaviors Recorded : \ ^ - 

1) Wrist and Ankle actometer scores; ^' , 

2) Number of Wo rksheet'^ - fetems completed during the Restricted Academic 

period. . , > 

Inter rater Reliabi litv : " ^ ^ ; - '"'^^ 

The average intraclass correlation for. the^pbserved behaviors was 
greater than .95 for all behaviors except Attention. Shifts, for which 
tUQ 'correlation was .87. 

AH the Playroom variables were transformed by a Log (N + l) transl 
for th9se variables employing a f requency^^count and an arcsin of the 
-iquare'root transformation for tli(is.a_yariQbJ_es_expressed as a percentage. 

uf the time. ■-: '.•> ■ VA ' 
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^ . / TABLE 3 . ' 

•^A SUMMARY OF THE' STABILITY COEFFICIENTS AND CORRELATED T-TESTS 
COMPARING the' REFERRAL' AND FOLLOW-UP FREE PLAY VARIABLES . 



stability' xjtit ^x- at ^ Correlated 

Variable , Goefficient° ^Referral*^ Foliow-up'^ t-test^ 











/ 


WriSL ULLUlllcLci 




7 q'? 


2.97 


-1.15 ' 


Ankle actometer, 




2.54 


2.70 


-1.89^ 


Grid cross i^ngs 




1.& 


0.91 


2.82** 


On- task ' ^ 




' 1.23 


1.27 • 


-1.07 . . 


Attention shifts 


.08 


1 .30 


1,16 


3.61** 


Out-of -seat- 


.53^* 


. 0.66,, ' 


0.47 " 


2.66** 


Fidgeting 


.31* 


■ 0.1?" ' 


• 0.11 


0.78 


Vocalization 


.51** 


0.32 


0.19 


2.84** 



^All of the significant stability, coefficients remained so after the 
effects of age and IQ were partialled out. 

'^The means ref4ect the trqnsfbrmecl scores. .. .\ . 

^A positive score represents c decrease in the behavior over time, a 
negative score an increase. - ^ . . ' • 

' *? < .05 ' . ' 

'**P"<<01 . ' ^ ■ ' ■ . ■ ' . 
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• ., TABLE ^■ " 

' A SUMMARY OF THE STABILITY COgRyCIENTS AND CORRELATED T-TESfs 
XOMPARING'THE REFERRAL AND FOLLOW-UP RESTRICTED ACADEMIC VARIABLES 



Variable 



X at 



Stability . x at , 
Coefficient^ "Referral'^ Follow-up 



Correlated 
^ t-test^ 



^rist actometer > 


- .46*^* 


2.73 


2.71 


0.34 


Ankle actometer ^ 


1 .24 , 


'2.45 


2.57 


-1.30^ 


Grid crossings 


. 57** 


0.62. 


0.51 


. i:88-. 


On-task • 


■ .33* 


V '^0.92 


1.12 


. -3^74*-^ 


• Attention shifts 


-.09 


1.25 


r.i4 


^' 1.72 ' 


Out-pf-seat 




0.21 


0.14 


1 . 70 


Fidgeting 


.45** 


0.39 


o:3i 


2.30* 


Vocal ization 


.29* 


M^.33 


0.18 


2.85** 


Forbidden Toys 


.08 


0.11 


0.11 


-0.05 


Worksheet items 


.35* 


2.00 


2.29 


' -5.00** 



completed 



°Ali of the signi'ficant stability coefficients, 'except for Worksheet 
item^ completed , remained so after the effecfeVof age and IQ were 
partial led out. ' . V 

^The means reflect the transformed scores. 

^A positive score represents'a decrease in the behavior over time', a 
negative score an increase. 

*P < .05 

**P < .01 ^ . . 
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A SUMMARY OF THE STABILITY. COEFFICIENTS AND CORRELATED T-TESTS 
COMPARING- THE REFERRAL AND VoLLOW- UP RATING SCALE FACTORS 



Stability /x at ' x at ' Correlated 
Variable Coefficient^ Referral^ Follow-up^ t-test^ 



Teacher Hyperactivity 


.42** 


. 1.67 


1.33 


' 2.51* 


rTeocher Aggression 




1.20 


1.06 ■ 


1.15 


Mother Hyperactivity 


.34** 


1.34 


0.75' 


5.02** ' 


Mother Aggression 


.39** 


"l.46 


1.08 , 


3.22**' 



°The significant stability coeff.icients^ relnair. . 30 after the effects 
of age and IQ were partial led out. 

^The values reflect the mean score per item.- 
■ ■f'^A positive ^core represents a, decrease in the rating over time. 

r ■ ■ . •■ ' r 

*P < .05 . . 

**P < .01 ■ / 



- - TABLE 6 

• CORRELATIONS BETWEEN JHE SYMPTOM FACTORS. FROM REFERRAL AND THE . ' 
/ -^r ■ FREE 'PLAY, VARIABLES- FROM F^LOW-UP ,, , . • 

Variable, t • Hyperactivity ^ - ' Ag gression 



Wrist actonleter ' . .24 • - . -.0^ 

Ankle actometer". ' .40**° . -07 

Grid crossings. . .48*"*° .13 

On-task , ■ ■ . ... -.21 -.13 

Attention shifts , , ' .28* " ' . " .20 

Out-of-seot . .32* . . .22 

Fidgeting' -.23 ' • -.30 

Vocalization • . V -19 - ' .O^t 



°The Hyperactivity factor made a significant and unique contribution to 
predicting the. obse/vation variable, beyond the variance it shared 
with the Aggression factor. 



*P < .Q5 
**P < .01 
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C0RRELAPIPNS BETWEEN, THE SYMPWi FACTORS FROM REI^ERRAL 
AND THE RESTRICTED ACADEMIC VARIABLES FROM FOLLOW-UP 



Variable 



-Wrist actometer 

Ankl^e actometer 
■ Grid 'c;rossings 

On-task; 

Attention shifts 

Out-bf-seot 

Fidgeting 

Vocalization 

Forbidden toy 

Worksheet items completed 



Hyperactivity 



Aggression 



33**0 . 




.5P 


51**° 




.o^ 


39**° 




. .16 


32**0 


* t 


. -.22 


32* 




. ■27 


35**° 




.10 


25' 




-.01 


^3**0 




.12 


23*0 




,.03 


40**° 




-.20 



°The Hyperactivity factor mode o significant and uni.que contribution 
to predicting the observation variable, beyond the variance it 
shared" with' the Aggression factor. 



*P < .0^ 
**P < .01 



